Goto

Collaborating Authors

 duolingo english test


Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study

Burstein, Jill, LaFlair, Geoffrey T., Yancey, Kevin, von Davier, Alina A., Dotan, Ravit

arXiv.org Artificial Intelligence

Artificial intelligence (AI) creates opportunities for assessments, such as efficiencies for item generation and scoring of spoken and written responses. At the same time, it poses risks (such as bias in AI-generated item content). Responsible AI (RAI) practices aim to mitigate risks associated with AI. This chapter addresses the critical role of RAI practices in achieving test quality (appropriateness of test score inferences), and test equity (fairness to all test takers). To illustrate, the chapter presents a case study using the Duolingo English Test (DET), an AI-powered, high-stakes English language assessment. The chapter discusses the DET RAI standards, their development and their relationship to domain-agnostic RAI principles. Further, it provides examples of specific RAI practices, showing how these practices meaningfully address the ethical principles of validity and reliability, fairness, privacy and security, and transparency and accountability standards to ensure test equity and quality.


AI Research Director, Duolingo English Test at Duolingo - United Kingdom

#artificialintelligence

This position is remote based in the United Kingdom. Our mission at Duolingo is to develop the best education in the world and make it universally available. But we've got more left to do -- and that's where you come in! Duolingo is the most popular language-learning application in the world, with over 500 million users and over half a billion exercises completed daily. Beyond our core learning product, we have also entered into literacy with Duolingo ABC and English proficiency testing with the Duolingo English Test.


Machine Learning Research Scientist

#artificialintelligence

Our mission at Duolingo is to develop the best education in the world and make it universally available. But we've got more left to do -- and that's where you come in! Duolingo is the most popular language-learning application in the world, with over 500 million users and over half a billion exercises completed daily. Beyond our core learning product, we have also entered into literacy with Duolingo ABC and English proficiency testing with the Duolingo English Test. We are passionate about educating our users, making fact-based decisions, and finding innovative solutions to complex problems.